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ENGLISH SCORE, ALLOWANCE MADE FOR THE EFFECTS OF PUPIL 
INTELLIGENCE, HIGH SCHOOL SIZE, AND PUPIL SOCIO-ECONOMIC 
BACKGROUND, GRADE 12 84 
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45 SIZE DUMMY VARIABLES RELATED TO PUPIL PERFORMANCE, 

MATHEMATICS SCORE, NO ALLOWANCE MADE FOR THE EFFECTS 
OF PUPIL INTELLIGENCE, HIGH SCHOOL SIZE, AND PUPIL 
SOCIO-ECONOMIC BACKGROUND, GRADE 12 85 

46 SIZE DUMMY VARIABLES RELATED TO PUPIL PERFORMANCE, 

MATHEMATICS SCORE, ALLOWANCE MADE FOR THE EFFECTS OF 
PUPIL INTELLIGENCE, HIGH SCHOOL SIZE, AND PUPIL SOCIO- 
ECONOMIC BACKGROUND, GRADE 12 85 

47 SIZE DUMMY VARIABLES RELATED TO PUPIL PERFORMANCE, 

CENERAL SCHOOL APTITUDE SCORE, NO ALLOWANCE MADE FOR 
THE EFFECTS OF PUPIL INTELLIGENCE, HIGH SCHOOL SIZE, AND 

PUPIL SOCIO-ECONOMIC BACKGROUND, GRADE 12 86 

48 SIZE DUMMY VARIABLES RELATED TO PUPIL PERFORMANCE, GENERAL 

SCHOOL APTITUDE SCORE, ALLOWANCE MADE FOR THE EFFECTS OF 
PUPIL INTELLIGENCE, HIGH SCHOOL SIZE, AND PUPIL SOCIO- 
ECONOMIC BACKGROUND, GRADE 12 86 

49 SIZE DUMMY VARIABLES RELATED TO PUPIL PERFORMANCE, 

GENERAL TECHNICAL APTITUDE, NO ALLOWANCE MADE FOR THE 
EFFECTS OF PUPIL INTELLIGENCE, HIGH SCHOOL SIZE, AND 

PUPIL SOCIO-ECONOMIC BACKGROUND, GRADE 12 87 

50 SIZE DUMMY VARIABLES RELATED TO PUPIL PERFORMANCE, 

GENERAL TECHNICAL APTITUDE, ALLOWANCE MADE FOR THE 
EFFECTS OF PUPIL INTELLIGENCE, HIGH SCHOOL SIZE, AND 

PUPIL SOCIO-ECONOMIC BACKGROUND, GRADE 12 87 

51 SIZE DUMMY VARIABLES RELATED TO PUPIL PERFORMANCE, 

ENGLISH FACTOR SCORE, NO ALLOWANCE MADE FOR THE EFFECTS 
OF PUPIL INTELLIGENCE, HIGH SCHOOL SIZE, AND PUPIL 
SOCIO-ECONOMIC BACKGROUND, GRADE 12 88 

52 SIZE DUMMY VARIABLES RELATED TO PUPIL PERFORMANCE, 

ENGLISH FACTOR SCORE, ALLOWANCE MADE FOR THE EFFECTS 
OF PUPIL INTELLIGENCE, HIGH SCHOOL SIZE, AND PUPIL 
SOCIO-ECONOMIC BACKGROUND, GRADE 12 88 

53 SIZE DUMMY VARIABLES RELATED TO PUPIL PERFORMANCE, 

MATHEMATICS FACTOR SCORE, NO ALLOWANCE MADE FOR THE 
EFFECTS OF PUPIL INTELLIGENCE, HIGH SCHOOL SIZE, AND 

PUPIL SOCIO-ECONOMIC BACKGROUND, GRADE 12 89 



Chart 

No. 



54 SIZE DUMMY VARIABLES RELATED TO PUPIL PERFORMANCE, 

MATHEMATICS FACTOR SCORE, ALLOWANCE MADE FOR THE EFFECTS 
OF PUPIL INTELLIGENCE, HIGH SCHOOL SIZE, AND PUPIL 
SOCIO-ECONOMIC BACKGROUND, GRADE 12 89 
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SUMMARY 



This is a study of the relationship of public high school per- 
formance to expenditure per pupil and high school size. The data used 
were generated by the American Institute for Research (Project 
Talent) for 775 put'ic high schools in the continental United States. 
An attempt was made to evaluate 12 potential measures of high school 
performance. Nine of these were either achievement tests or factor 
scores based on all tests. The remaining three were constructed 
to measure the breadth of curriculum and facilities. What were 
judged to be the most important of these output measures were 
than related to high school expenditure and size in a simple model 
of the educational process in which performance of pupils from 
similar socio-economic backgrounds is explained by a general intel- 
ligence factor score, school expenditure, school size, and an index 
of pupil socio-economic background. 

When all the public high schools were considered together, it 
was found that expenditure was significantly related to performance 
with $100 of expenditure typically being associated with between 
one and two tenths of a standard deviation of the output variable. 
Also for all high schools, it was found that increased size was 
negatively related to most measures of performance. With respect 
to pupils from different home environments, it was found that school 
expenditure is related more consistently to the performance of 
children from better socio-economic environments. 

The study also analyzes in great detail the differences in 
the performance of the variables in the model relative to regional 
and urbanness differences. The results for within groups of high 
schools cross-classified by both region and urbanness was that 
there seemed to be little relationship of expenditure and size to 
performance. At a slightly higher level of aggregation, however, 
relationships similar to those for all schools taken together were 
often found for all northern and western high schools and for high 
schools in the urban, small town, and rural urbanness categories. 

Further work is necessary with this sample in the area of re- 
lating individual school characteristics to the measures of per- 
formance. 
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INTRODUCTION 

Tv'o things critically curtail the ability of economists to pro- 
vide insight into the efficiency of government operations. First, 
there are no profits to serve as guideposts; and secondly, the product 
itself is poorly defined. While the first of these facts makes it 
extremely important that economic analysis of government operations 
be undertaken, the second makes such analysis highly impractical. 

In the education sector, the project definition difficulty is 
basically the inability to isolate differences in educational quality. 
Thus, the quantity of children educated is easily learned, but the 
quality of the individual educations received, other things equal , is 
extremely difficult to determine. To conduct economic analysis of a 
public sector such as education, therefore, a measure of output, which 
means a measure of output quality , is required. In the past several 
years, economists have come to believe that the achievement test 
score in basic subjects, while not perfect, might be such a measure.^- 
This study is within that tradition. 

Assuming that scores on objective tests are viable measures of 
school quality, and also that good objective test data are available, 
what kind of analysis would then be possible? While the possibilities 
for useful research would undoubtedly be many, there are three general 
types of problem which would be of central interest, at least to 
economists. First, what can be discovered concerning the effect upon 
school efficiency of increases in school size? Secondly, how much 
apparent return is there in terms of educational quality from the 
expenditure of additional dollars per pupil and how does this differ 
for children from different kinds of socio-economic backgrounds? 
Thirdly, what combinations of school inputs produce the most efficient 
outcomes? The last of these questions has been the subject of con- 
siderable attention on the part of economists in the past few years. 
Attempts to construct school "production functions" ^ have not met 
with unqualified success, to say the least, and it is probably fair 
to say that the problem is not capable of meaningful solution at the 
present state of the arts. Since this is true, the present study 
will deal almost exclusively in attempting to provide answers to the 



1". . . despite . . . qualifications, we take the position that 
achievement in basic subjects is the most widely accepted and the most 
important dimension of educational output. Learning in these subjects 
is a necessary part of the foundation for accomplishing the things 
that most people, individually or a<> nations, seem to want. We think, 
therefore, that scholastic per forma ace. is an appropriate measure of 
output to use in comparing educational policy." Joseph A. Kershaw 
and Roland N. McKean, Systems Anal /sis and Education (Santa Monica, 
California: RAND Corporation, RM-2473-FF, 1959), 9. 

^"Production Function" can be defined as the set of causal rela- 
tionships between output of a process and various possible combinations 
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first two problems posed above with respect to the public high schools 
in the Project Talent Sample. 3 

The analytical scheme upon which most of the findings in this 
study are based is similar to that used by the author in an earlier 
study of school districts in New York Stated It is based upon the 
hypothesis that a person's education is dependent upon his native 
ability and home background (through which comes most of his educa- 
tional motivation), besides his formal education. The analytical 
scheme is discussed in much more detail below. 

After a brief description of the Project Talent data and some 
other studies, the remaining parts of this report will deal with the 
characteristics of alternative measures of performance and the analyt- 
ical scheme in more detail (Part II), and detailed presentation of find 
ings concerning the relationships of expenditure and size to perform- 
ance (Parts III & IV). Finally, in Part V the findings from the study 
are related to those of other studies and some conclusions are given. 



The Project Talent Data • 

There is much published material concerning the Project Talent 
sample of high schools and there is little reason therefore to des- 
cribe it in great detail here.^ The original Talent sample was 



of inputs. Possible inputs into school production functions would 
include the quantity and quality of teachers, physical plant, train- 
ing aids, etc. 

^This does not mean that much cannot be learned from an investi- 
gation into the apparent relationships which exist between school 
"inputs" and school quality, and the author intends to further pursue 
this issue with the Project Talent High Schools. An adequate attempt 
to delve into these relationships would have been too expensive and 
time consuming to come within the present study, however, especially 
since the data are such that supplemental data collection would have 
to be undertaken. Relationships between three important school 
characteristics and pupil performance on nine different measures are 
given in Table 3 below. 

^See, Herbert J. Kiesling, "Measuring a Local Government Service: 
A Study of School Districts in New York State," Review of Economics 
and Statistics . August, 1967, pp. 356-367. 

^The quickest way for the reader to gain a full appreciation of 
the Project Talent Study would be to obtain a specimen set of the 
Project Talent testing materials and a description of the data found 
in "The Project Talent Data Bank," (Project Talent, University of 
Pittsburgh, 1965). The latter publication includes a listing of the 
major publications of Project Talent on the inside front cover. A 
major publication not mentioned there, however, is the discussion of 
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comprised of 1353 high schools of all types, or about 5 percent of all 
the secondary schools in the United States, picked on a stratified 
random basis. Of the high schools in the Project Talent Sample, only 
the public general comprehensive and/or college preparatory high schools, 
of which there are 775, are used in the present study. Characteristics 
upon which the Project Talent Sample was stratified included geograph- 
ical area, size of senior class, school category, and retention ratio 
(holding power). The stratification by geographical area was done 
according to 56 strata, including the five largest cities plus the 
District of Columbia along with the 50 states. Weights were assigned 
such that larger schools would be represented somewhat mo'e frequently 
than smaller schools. ^ No effort has been made: to correct for these 
sampling ratio differences. ‘ Since the purpose of this study is 
analytical in nature instead of descriptive, such a procedure would 
have been most expensive and time consuming considering the benefits 
received. Differences in sampling ratio are not great for rho schools 
which are of greatest interest to this study, high schools with 25 or 
more seniors. Nor has there been a correction made for differences 
in weighting according to region for the same reasons. The within- 
region analysis given below should make such correction unnecessary in 
any case. 

The Project Talent data were collected in the spring of the 1959- 
1960 school year, when pupils in the four high school grades were given 
sixty different tests in a two-day period. Long questionnaires were 
filled out by the principal, chief guidance counselor, and each indi- 
vidual pupil. The questionnaires were, from the point of view of 
economists, somewhat deficient, which is unfortunate since it would 
have taken little additional effort to improve some of the items of 
economic data a great deal. 7 



the Talent factor score findings in Paul R. Lohnes, Measuring Adolescent 
Personality . (Project Talent, University of Pittsburgh, 1966). 

^The sampling ratios used were: 

Schools with fewer than 25 seniors 1:50 

Schools with 25 to 399 seniors 1:20 

Schools with 400 or more seniors 1:13 

^The main criticism to be made is that the questionnaire was 
designed to provide intervals when many of the variables could have 
been made continuous just as easily. For example, one crucial item 
for economists has to do with teacher salary. The question for male 
teachers’ starting salary was: 

’’What is the annual starting salary in your school for male 



secondary 


teachers with a bachelors 


degree and 


no experience 


( ) 


1. 


Less than $1000 


( ) 


6. 


$3000-$3499 


( ) 


2. 


$1000-$1499 


( ) 


7. 


$3500-$3999 


( ) 


3. 


$1500-$1999 


( ) 


8. 


$4000-$4499 


( ) 


4. 


$2000-$ 2499 


( ) 


9. 


$4500-$5000 


( ) 


5. 


$2500-$2999 


( ) 


10. 


$5000 or more 


Footnote 


continued on next page. 
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There were originally approximately 100,000 individual pupil 
observations in each grade. Of these, Project Talent picked a 
random 10 percent sample of pupils in grades 9 and 12 and performed 
a complete factor analysis of their scores. Since these factor 
scores were important to the present study, the two 10 percent 
samples which include factor scores for grades 9 and 12 are those 
forming the basis for the analysis herein. For the 775 public 
comprehensive and college preparatory high schools there were about 

10.700 useful observations, of which 5,000 were in grade 9 and 

5.700 were in grade 12. These observations were summarized into 
svsrsgss according to grade, high school, and socio-economic back— 
ground, and these summary statistics are the school observations for 
the study. As the reader will see below, the individual pupil records 
are also used extensively in the analysis. 



The Plan of This Study Related to Prior Work 

The working hypothesis being used in this study is that specific 
control must be exercised to account for differences both of pupil 
intelligence and socio-economic background before problems of the 
relationship of school variables to school quality can be investigated. 
The procedure used for accounting for socio-economic background dif- 
ferences has been to stratify pupils into (hopefully) homogeneous 
groupings, i.e., to fit the basic regression model to the performance 
of pupils from similar socio-economic backgrounds. The intelligence 
effect is accounted for, on the other hand, by introducing the intel- 
ligence variable as one of the variables in the multiple regression 
explanatory equation. There are no other studies, with the exception 
of one earlier work by the author, which accounts for the important 
socio-economic variable with a stratification scheme. There are 
three studies, however, which attempt to control for intelligential 
and socio-economic differences before examining the formal school^ 
process. These are studies by Burkhead,' / Coleman, and Katzman. 



It would have been just as easy and much more exact for the 
principal to have filled in the exact figure. The question still 
would not have been bad if it had not been for the open end at the top. 

®Kie sling, o£. £it. Also see Herbert J. Riesling, "Measuring a 
Local Government Service: A Study of the Efficiency of School 

Districts in New York State," Unpublished Ph.D. Dissertation, Harvard 
University Library, 1965. 

9 Jesse Burkhead, with Thomas G. Fox and John W. Holland, Input 
and Output in Large-City High Schools . Syracuse, N.Y. , Syracuse 
University Press, 1967. 

10 James S. Coleman et al., Equality of Educational Opportunity , 
Washington, D.C., U. S. Government Printing Office, 1966. 

■^Martin T. Katzman, Distribution and Production in a Big City 
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The Burkhead work is a study of high schools in Chicago, 

Atlanta, and in the Project Talent Small Community Sample, which 
contains some high schools also included in this study. Quality 
measures used include post-high-school education, number of drop-outs, 
and reading scores for grade 11. Burkhead introduces both intelli- 
gence and a good socio-economic variable (median family income) as 
explanatory variables along with various school inputs. His use of 
the intelligence variable leaves something to be desired, however. 

The study by Coleman and associates introduces eight variables 
to explain pupil performance, although it would appear that none of 
these variables is pupil intelligence as such. The eight variables 
include three to represent student backgrounds and attitudes; two 
to represent school factors; two to represent teacher factors; and 
one to, represent student body qualities. 



Elementary School System . Unpublished Ph.D. Dissertation, Yale 
University Library, 1967. 

Two other studies, while not attempting specifically to control 
for socio-economic and intelligential differences before examining 
school quality, are nevertheless relevant to the work in this study. 
These are studies by Benson and James et^ al. (Senate of the State 
of California, Committee on Revenue and Taxation, State and Local 
Fiscal Relations in Publi c Education in Californi a . March, 1965, 
Chapter A, "A. Study of Pupil Achievement." H. Thomas James, 

J. Alan Thomas, and H. J. Dyck, Wealth, Expenditures and Decision 
Making for Education , Office of Education, Cooperative Research 
Project No. 1241-, 1963.) Both studies are content to examine the 
gross relationship of various school and community variables to 
pupil performance. Professor Benson has a variable for pupil 
intelligence, however, but feels that the high correlation between 
the intelligence and achievement variables (which he argues is due 
to overlapping of the variables) precludes the effective use of the 
intelligence variable. 

^Of the two models used, one does not use the intelligence 
variable at all while the other uses it incorrectly. Thus, in what 
Burkhead claims to be a "value added approach to high-school educa- 
tion" (page 53), the 11th grade test scores are predicted on the 
basis of 9th grade I.Q. scores and then the residuals are used as 
the explained variable for the explanatory model. This is an incor- 
rect procedure which leads to biased estimators for the other explan- 
atory variables in the model and undoubtedly greatly overstates the 
effect of the I.Q. variable. The basic problem involved is that the 
procedure does not properly allow for interaction effects. The cor- 
rect procedure would have been to make I.Q. one of the explanatory 
variables along with the others. For a proof of this, see Arthur S. 
Goldberger, Econometric Theory , New York, John Wiley and Sons, 1964, 
pp. 194-195. 



Finally, Martin Katzman lias studied 56 school "districts" in 
Boston in an attempt to explain school quality as measured by six 
variables. The quality variables used in:lude attendance rate, 
membership rate, gains in reading score between grades 2 and 6, the 
percentage of children applying to Boston Latin School, the percen- 
tage of children being admitted to Boston Latin School, and continua- 
tion rate. These measures of performance are related to various 
school characteristics net of the effect of an aggregate socio- 
economic background variable. Katzman does not account for differ- 
ences in pupil intelligence. The explanatory variables in Katzman* s 
model include, besides the socio-economic background variable, the 
percentage of students in crowded classrooms, pupil staff ratio, per- 
cent teachers with permanent status, percent of permanent teachers 
with Masters Degrees or better, percent teachers with one to ten 
years* experience, percent annual teacher turnover, and percent of 
student members in the district. One problem with the Katzman 
study is that the independent observations might not be truly 
independent. ^ 

Some of the findings from the study just mentioned plus those 
mentioned in Footnote 11 will be discussed in the final section of 
this paper after the findings from the present study have been dis- 
cussed. Before the findings can be given, however, it will be 
necessary to discuss the quality measures being used in some 
detail (Part III). 



l^Katzman* s "school district" is not the school district 
using the accepted meaning of the term which is an independent 
policy-making, often highly autonomous, educational entity. The 
56 school "districts" in the city of Boston have little or no 
independent policy-making discretion, do not decide teacher salary 
levels, do not in the main decide other expenditure questions. 
These questions are all settled centrally by the Boston School 
Committee. There is some question, therefore, whether Katzman 
has 56 observations in the accepted sense of degrees of freedom 
for econometric analysis. The fact that Katzman gets unbelievably 
high coefficients of corrected multiple determination in many of 
his multiple regressions is probably in part due to this lack of 
independence. 

This criticism is also applicable to the Burkhead study of 
high schools in Chicago and Atlanta. 
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II 



CONSTRUCTING A QUALITY MEASURE FOR EDUCATION 

It is probably true that objective comparison of relatively large 
numbers of schools or school districts will require results of objec- 
tive tests. But what kind of tests, concerned with what kind of sub- 
ject matter, might be best as a measure of school quality? Also, and 
just as important, is it possible to construct a good measure of pupil 
native ability? It is to these questions that Part II is devoted. 

A total of 12 different measures were considered for use as qual- 
ity measures for this study. These measures belong to three distinct 
sets or types, according to the methodology of their construction. 

The first set, comprising four tests, are "traditional” types of tests, 
where pupils are asked to answer multiple choice questions constructed 
along various subject lines. Hie four tests used have for their sub- 
ject matter English, Mathematics, General School (academic subject) 
Aptitude, and General Technical Aptitude. The Technical Aptitude test 
covers such things as the knowledge of engines, electricity, physical 
laws, etc. The teaching of such skills conceivably is an important 
facet of school quality which is not captured in the more academic 
measures. 

The second type of measure used, consisting of three tests, is 
based. upon the presumption that one important aspect of school quality 
has to do with the number of facilities offered by the school to its 
pupils. Three such measures were constructed by the author to be 
made up of various combinations of answers on the General School 
Questionnaire. They are based upon the special facilities avai|.^ble, 
and total number of courses available in the school curriculum. 



^Two political scientists, Henry J. Schmandt and G. Ross Stevens, 
have argued that a good indication of the quality of public service 
outputs is obtained by counting the number of services offered. 
("Measuring Municipal Output," National Tax Journal , December 1960, 
pp. 369-375.) There are serious drawbacks to such a procedure and yet 
the basic idea might in certain instances be useful. The basic draw- 
back to the approach is that the relative importance and quality of 
the different services is ignored. 

15 

The three measures were constructed as follows: 

Special Facilities Measure . The special facilities measure was 
meant to capture the facilities available for educating better-than- 
average pupils. The measure contains 22 items: number of tracks (4), 

number of separate classes available (such as classes for the mentally 
retarded, non-English speaking, rapid learners, etc.) (12), and number 
of types of accelerated curriculum available (6). 

Total Facilities . Principals were asked to check the number of 
facilities provided from a list on the back of the school questionnaire. 
There were 37 items on the list and three more provided rather often by 
the principals, for a total of 40. The first 10 items on the list are: 
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The third set of potential measures of output consists of five 
factor scores, which along with the sixth factor score for pupil in- 
telligence, must be discussed in somewhat more detail. While not as 
straight forward to interpret, the pattern of underlying trait rela- 
tionships for these factors seems to be accepted fairly widely by 
educational psychologists. If this is true, it would be of great im- 
portance, since the chances are that similar normalized factor scores 
might be drawn from dissimilar starting batteries of tests. 

To understand the factors themselves, it is necessary to be aware 
of the general theoretical construct on which they are based, and, 
although this is outside the author's professional competence, a brief 
attempt to give the rudiments of the construct is given here. *-6 The 
discussion is based upon the Project Talent description of the factors 
written by Paul R. Lohnes.^ According to Lohnes, human abilities are 
arranged into a hierarchy of traits, with general intelligence serving 
as the basic foundation stone. Lohnes attributes this approach to 
Robert Gagne, although a similar theory was also enunciated in Vernon. 

"Gagne holds that individual differences in rate of achieve- 
ment are related to differences in amount and kinds of avail- 
able relevant knowledge. These knowledges are organized in a 
hierarch of learning sets, in which subordinate sets mediate 
transfer to higher level sets. Incidently, he hypothesizes 
lower-level learning sets that are quite similar in nature to 
what we will define as aptitudes. He makes acquisition of 



health examination, school library, health clinic, social worker or 
visiting teacher, teacher of the "home bound," free lunches, school 
doctor, school dentist, recreation worker, and school psychologist. 

Curriculum Measure . The principals were also asked to check 
which courses were available at their high schools on a long list of 
potential courses provided in the questionnaire. The total number of 
items possible in this measure is 308. The following are the types 
of courses included in the measure along with the number of possible 
offerings for each provided for in the questionnaire: English (28), 

Social Studies (29), Science (42), Mathematics (15), Foreign Languages 
(49), Industrial Arts non-vocational (34), Business Education (32), 
Home Economics (22), Religious (7), Agriculture (15), Music (14), 

Art (13), Other Instruction (8). 

16 The author is deeply indebted to Professor Richard L. Turner, 
an educational psychologist in the Indiana University School of 
Education, for helpful insights into the general meaning of the theo- 
retical issues underlying the discussion to follow. It must be most 
emphatically stated, however, that Professor Turner should not be held 
responsible for any errors of interpretation that exist. 

17Qp. cit . 

■^Philip E. Vernon, The Structure of Human Abilities . New York, 
John Wiley and Sons, 1950. Also see Anne Anas t as i, Individual 
Differences , New York, John Wiley and Sons, 1965. 
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required specific knowledges dependent upon the mediation of 
appropriate aptitudes, in part, and in turn, higher level 
achievements (what we would call higher mental processes) 
depend primarily on transfer from immediately subordinate 
specific knowledges. Gagne's paradigm is essentially this: 

COMPLEX ABILITIES 

t 

BASAL KNOWLEDGES 

t 

DIFFERENTIAL APTITUDES 

Gagne's theory suggests that there is a particular bundle of 
special knowledges that must be assembled to permit mastery of 
a particular complex ability. Our footnote to this is that a 
pervasive source trait of general intelligence collaborates 
with a special set of lower-level aptitudes in facilitating 
the acquisition of any special set of basal knowledges.'* (Page 
1-32) 

Standing on the foundation of intelligence, there are two other source 
traits upon which, together with intelligence, all other abilities are 
based, i.e., all ability traits are constructed from differing combina- 
tions from these three "building blocks." There are two "basal knowledges, 
having to do with language and mathematics skills. 

"A knowledge is a performance trait that enables the sub- 
ject to reproduce associations or to complete Gestalts from a 
broad class of cognitive holdings. A knowledge trait is an 
ability to generate and apply information in a subject-matter 
area. Knowledges may depend more on specific learning oppor- 
tunities and less on inate characteristics of the central nervous 
afferent and efferent systems than do aptitudes. . . . Two 
important knowledge factors, uncorrelated with Verbal Knowledges 
and uncorrelated with each other, appear in our theory: English 

Language and Mathematics." (Page 1-33) 

Finally, there are the specialized abilities. 

"An aptitude is a performance trait that facilitates spaed 
and precision of response to items from a specific, unique class 
of relatively simple tasks. Our theory locates three such classes 
of tasks in the TALENT abilities test, and defines as a set of 
three differential aptitude factors Visual Reasoning, Perceptual 
Speed and Accuracy, and Memory, each of which has ample precedent 
in the literature." (Page 1-33) 



Individual Tests Associated with Each Factor 



Additional insight can be obtained from en examination of the nature 
of the individual Project Talent tests which make up, or "load highly 
upon," each factor ^core. This is done in this section for the six 
scores beginning wi h the one for pupil intelligence. 



The Verbal Knowl6dg6S Factor 



... ^ Verbal Knowledges Factor is meaningfully associated positively 

for h lsV f h<! 60 ^ ect Talent tests and the factor itself accounts * 
or 18.7 percent of the total variance generated by the 60 tests. 

According to Lohnes the Verbal Knowledges Factor is: 

T « '* * ,* ° Ur closest approximation to General Intelligence 
or I.Q Technically, (Verbal Knowledges) is a factor, since 
every single one of the 60 ability tests has a positive non-zero 
correlation with this factor. . . Spearman insisted on the 
purely formal character” of £, saying: 'It consists in just 

^onstituent-whatever it may be— which is common' to all 
the abilities. .' He defined £ not by what it is, but by where 
it can be found. The only requirement is that £ must 'enter 
into all abilities whatsoever.' (The Verbal Knowledges Factor 
Score) satisfied this requirement,*' (Page 3-20) 

and t S T P °\ Slb ! e t0 list aU 25 0f ‘he tests which loaded strongly 

eonsistentiy with the Verbal Knowledges Factor. The reader is referred 

cor^la^lth th C “f Si r f ° r m0r 5 detai1, The ten tests which were most 
orreiated with the factor, in order of importance, are: Art, Social 

Studies, Literature, Foreign Travel, Vocabulary, Music, Theatre and Ballet 

Reading Comprehension, Bible, and Miscellaneous Information. 

, ,' It is ^wtant to notice that the title "Verbal Knowledges" is 
Ik?*! J artificial since it is used merely as a name less 
susceptible of misunderstanding than the term "intelligence. "1® It is 
true, also, that the factor is made up more of language traits than sav 
mathematics traits. Many educational psychologists seem to feel that 
general intellectual ability is highly associated with language skills. 20 



English Factor 

_ , , n The . teS ^ S rT wh i ch are hi 8 hl y correlated with the English Factor in- 
ii D p®f UiS ? d Words » Spelling, Capitalization, Punctuation, English 
Usage, Effective Expression, Word Functions and Sentences, Reading Com- 
prehension, Arithmetic Reasoning, and Arithmetic Computation. Of these 
the disguised words and reading comprehension tests were more highly 
associated with the Verbal Knowledges Factor than the English Factor. 

It might be hypothesized perhaps that the tests which are listed, with 

th ! reading comprehension and arithmetic tests, seem to 
e En glish skills of a more mechanical or secretarial variety. If so 

\ . c ? ul b f that such skills would not be more prevalent at high schools 
which are better academic institutions. Also, pupils who are more 

interested in such skills might be found in low (but not the lowest) 
socio-economic strata. 



19 See Lohnes, o£. cit . , page 3-20. 
^Lohnes, ibid. 




11 



Mathematics Factor 



It is possible that the Project Talent Mathematics Factor is 
theoretically a good measure of school quality, since, mathematical 
ability is probably a more school-related trait than language ability. 
Verbal ability can easily be learned in highly literate homesj some 
such knowledge is transmitted regardless of how good or how bad the 
formal education process might be. Mathematical skills are, on the 
other hand, gained at home much less often. Even when the parents 
are adept at mathematics, such as would be true with engineers for 
example, there must still be a conscious effort made on the part of 
the parent to teach the skill (helping with homework). It is problem- 
atical that such an effort is often made to teach the child concepts 
when they are not being covered at the same time in school. 

A second, somewhat more tenuous, reason why the Mathematics Factor 
might be a good school quality measure is that the Verbal Knowledges 
Factor, while removing some academic language skills from the English 
Factor, does not do the same with academic mathematics skills with 
respect to the Mathematics Factor. 2 ! individual tests which are 
highly correlated with the Mathematics Factor include Mathematics (a 
test also used as an output measure in this study), Physical Sciences, 
Introductory Mathematics, and Advanced Mathematics. 



Visual Reasoning Factor Score 

Tests which are associated with the Visual Reasoning Factor are 
Creativity, Mechanical Reasoning, Visualization in Two Dimensions, 
Visualization in Three Dimensions, and Abstract Reasoning. From the 
names of these tests, it seems likely that the Visual Reasoning Factor 
measures a kind of intelligence trait. Evidence presented below seems 
to indicate that it is an ability learned by pupils who are pursuing 
studies which are vocational in nature. 



Perceptual Speed and Accuracy and Memory Factor Scores 

The final two factors seem to represent skills that are unrelated 
to academic excellence and also, perhaps, to general intelligence. 

The i-irst of these, Perceptual Speed and Accuracy, is a clerical check- 
ing factor which includes loadings on the following tests: Arithmetic 

Computations, Table Reading, Clerical Checking, Object Inspection, and 
Preferences. The Memory Factor has to do with the ability to do rote 
memorization. Two tests load on it, Memory for Sentences, and Memory 
for Word 1 ?. It might be hypothesized that institutions which stress 
clerical and rote memory skills do so at the expense of academic 
excellence. 



21 My thanks go to Professor Richard Turner for suggesting this 
point. 
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S ummary; Factor Scores 

To summarize what has been said thus far with respect to the Project 
Talent factor scores, mathematics would seem to be on a priori grounds 
the best measure. The English Factor appears to include only the 
mechanical side of English skills, although perhaps it is important 
for this facet of formal education to be carefully examined also. It 
is reasonable to .accept the general intelligence factor (Verbal 
Knowledges) as a good I.Q, measure. The Visual Reasoning Factor could 
measure a type of intelligence that goes with vocational education. 

The Perceptual Speed and Accuracy and Memory factors are probably un- 
related to school academic excellence, and it may also be possible to 
say the same thing, to some extent at least, about the English Factor. 



Empirical Exploration Concerning the Measures of School Quality 

It might be possible to learn something more about these 12 poten- 
tial measures of school quality by examining their relationships to 
other variables about which we can reasonably expect to have some 
a priori notions. Five such variables are related to the quality 
measures: one to represent pupil intelligence, one for pupil socio- 
economic background, and three for school quality. 

Such a procedure includes an element of non-rigorous reasoning. 

To illustrate this, suppose it is assumed, perhaps on the basis of 
past empirical investigation, that average class size is highly re- 
lated negatively to school excellence. Having made this assumption, 
class size is related to (regressed upon) a potential quality measure. 
Suppose further that this yields a finding of "no relationship" between 
the two variables. In this situation there is reason to suspect that 
the quality measure is a poor one. But the measure may in fact be a 
good one; the problem is that the hypothesized relationship between 
average class size and quality is false. Formally, there are two 
unknowns but only one equation. Or, more correctly, the second equa- 
tion is somewhat intuitive in nature, since no one can be absolutely 
certain that the variables measure the qualities attributed to them. 
Despite this lack of complete rigor, there is evidence which can be 
cited in support of the hypothesized relationships for five variables 
and the value of this procedure should not be underestimated. 22 The 
hypothetical and empirical relationships of these five variables to 
the output measures will be discussed in turn, beginning with the 
intelligence variable. 



Pupil Intelligence and Quality 

Two possibilities exist with respect to the relationship of pupil 
intelligence to school quality. The first, which is the relationship 



^See Herbert J. Kiesling, "Empirical Evidence Concerning the 
Relative Educational Performance of Children from Disadvantaged 
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